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Abstract 

The Reinhold-Vadhan-Wigderson zig-zag product construction [5] pro- 
duces infinite families of good expanders of constant square degree. In 
this article we generalize their construction to produce infinite families 
of regular graphs of any constant degree. We analyze the second largest 
eigenvalue of this new zig-zag product to show that the modified zig-zag 
product of good expanders is again a good expander (yet not Ramanujan). 



1 Introduction 

Expander graphs are well connected yet sparse graphs. They have numerous 
applications in computer science and pure mathematics. For a wonderful in- 
troduction to expander graphs and their applications we refer the reader to pQ . 
Another excellent resource on the subject is the Lubotzky's book [2J. 

For any k - regular graph X, we denote by V(X) its vertex set and by E(X) 
its edge set. We denote by Ad(A) the adjacency matrix of X and let 

X(X) = max{|A| : A eigenvalue of Ad(X), |A| ± k}. 

Thus, X(X) is the second largest eigenvalue of Ad(X) in absolute value. If A 
is a collection of vertices of G, the boundary of A, denoted dA, is given by 
dA = {x G V \ A : {x, y} € E, some y G A}. 

Definition 1 A finite regular graph X on n vertices and of degree k is called 

n 

an (n, k, c)- expander if for every subset A ofV(X) with \A\ < — we have 

\dA\ > c\A\. 

The constant c is called the expansion coefficient. 

The expansion coefficient of a regular graph X depends on X(X). 

Proposition 1 A finite k-regular graph X onn vertices is an (n, k, c)-expander 
with 2c = 1 - \X(X)\/k. 

Proof: [3]. 

Thus, good expanders have small A(A). However, asymptotically A(A) can- 
not be made arbitrarily small. We have the following proposition. 
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Proposition 2 (Alon-Boppana) lim X(X n > 2\Jk — 1, where X n k is a 
k-regular graph on n vertices. 

Proof: [3J. 

This upper bound on A(G) leads to the following definition due to Lubotzky, 
Phillips and Sarnak. 

Definition 2 X n _k is called a Ramanujan graph if X(X n ^) < 2\Jk — 1. 

Inhnite families of Ramanujan graphs of constant degree have been con- 
structed using deep results from number theory [3J , [I] . The first purely combi- 
natorial construction of infinite families of good expanders (yet not Ramanujan) 
of constant degree is due to Rcingold, Vadhan and Wigderson [5]. These graphs 
are obtained by starting with two good expanders, a large graph G and a small 
graph H, and applying an operation called the zig-zag product to obtain a larger 
expander G©H. This graph has degree equal to the square of the degree of H 
and its expansion coefficient is determined by the expansion coefficient of both 
G and H. For applications, the fact that the resulting graphs are not quite 
Ramanujan is irrelevant. The construction is strikingly beautiful. 

In this article we introduce a modification of the zig-zag product which 
produces expanders of any degree. For the analysis of the eigenvalue as well as 
the definition of the modified zig-zag product we follow Luca Trevisan's more 
intuitive approach to the original construction and estimation of the second 
largest eigenvalue (see [B]). 

2 The modified zig-zag product 

Let G be a regular bipartite graph of degree d\ ■ d 2 with N\ left vertices and 
N2 right vertices. (This can be obtained easily from known methods since there 
is 110 requirement on N\ and N 2 ). We label the vertices of G with the integers 
1,2,..., |V(G)|, starting with the left vertices and ending with the right vertices. 
We often write v £ V(G) to mean the label of v. We fix a random labeling of 
the edges of G near each vertex. We say that i is the fc-th neighbor of j in G if 
i and j are adjacent and the edge connecting them is labeled k near j. Let Hi 
be a regular graph of degree d\ with d\ ■ di vertices and H2 be a regular graph 
of degree e?2 with d\ ■ di vertices. 

First we form the modified replacement product G ® (Hi, H 2 ) as follows. 
Replace each left vertex of G by a copy of Hi henceforth called a left cloud. 
Similarly, replace each right vertex of G by a copy of H 2 henceforth called a right 
cloud. We denote by (m, n) the n-th vertex in the m-th cloud of G®(Hi, H 2 ). 
Within the clouds we maintain the edges of Hi and H 2 respectively. The new 
graph G©(Hi, H 2 ) has the following additional edges between different clouds. 
If mi and m 2 are adjacent vertices in G such that mi is the 712-nd neighbor of 
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m 2 and m 2 is the m-st neighbor of mi, then (mi,rii) and (m 2 ,n 2 ) are adjacent 
in G®(H X ,H 2 ). The graph G®(H 1 , H 2 ) is a (di, d 2 )-biregular bipartite graph 
with (Ni + N 2 )did 2 vertices. 

Using the replacement product, we form the modified zig-zag product G ® 
(Hi,H 2 ). The graph G® (Hi,H 2 ) has the same vertex set as the replacement 
product. There is an edge in G®(Hi,H 2 ) between the vertices (i,p) and (j, q) 
if there are s and t such that {(i, s), (i,p)}, {(j, t), (j, q)} and {(i,s),(j,t)} arc 
edges in G ®(Hi, H 2 ) (i.e., if in the replacement product we can start at the 
vertex (i,p), take a zig step in the i-th cloud, move to the j-th loud and then take 
a zag step to reach the vertex (j, q)). The graph G@(Hi, H 2 ) is a di -d 2 - regular 
bipartite graph on (JVi + N 2 )d\d 2 vertices. The N\d\d 2 vertices belonging to 
the left clouds are the left vertices and the N 2 d\d 2 vertices belonging to the 
right clouds are the right vertices. 

To iterate, let Go = G and H\,H 2 be as above. Define G; = Gi-i®(H\, H 2 ), 
i = 1,2,.... Then {Gi}^ ^ s an infinite family of d\d 2 - regular graphs with 
lim \V(Gi)\ = oo. 

n—>oc 

3 Estimation of the second largest eigenvalue of 
the modified zig-zag product 

Theorem 1 Let G, H\ and H 2 be regular graphs as above. Suppose A(G) < 
ad\d 2 , \{H\) < (3\di and X(H 2 ) < (3 2 d 2 . Then 

X{G®( Hl ,H 2 )) + ! + PlP2 + [pi + |) J + (Pi + |) |) d ld2 . 

Proof: Let M be the adjacency matrix of G® (Hi, H 2 ). It is a matrix of size 
Nidid 2 +N 2 did 2 . Then 

A(G ® (Hi , H 2 )) = max | x Mx T \ , 

xJ.1, \x\ — 1 

where 1 represents the vector of the appropriate size (we will mention the size 
when not obvious) with all entries equal to 1. 

Let B be the adjacency matrix of the graph obtained from the replacement 
product G ®(Hi,H 2 ) by removing the edges between clouds. If we list the 
vertices of G® (Hi,H 2 ) beginning with the left vertices and ending with the 
right vertices, then the matrix B has the following form. 
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/ Ad(ffi) 



Ad(Hi) 



Ad(iT 2 ) 



V 



Ad(iJ 2 ) / 



Let ^4 be the adjacency matrix of the graph obtained from the replacement 
product G©(Hi, H 2 ) by removing the edges within the clouds. With the vertices 
of G® (Hi, H2) in the same order as for B, the matrix A is a block diagonal 
matrix with two all zero blocks on the diagonal of sizes N\d\d2 X N\d\d2 and 
x N2CI1CI2 respectively. Thus 
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Then M = BAB. The largest eigenvalue of M is d\d2 corresponding to the 
eigenvector 1. 



If x is a vector in 'S_ N i d i d 2+N 2 d 1 d2 ^ we denote the entries of x by 

\X\i, X12, . . . ,X 1 (d 1( i 2 ), X21, X22, ■ ■ ■ , X 2 (dK2 2 ): • • • i x {N 1 +No_) (d 1 d 2 ))- 

Thus Xij is the ((i — l)e?ie?2 + j)-th entry of x. 

Given a vector x € R-Wiw^+A^di^ ; we define, for each v £ V(G), a vector 
x v G R dld2 by (x v )k := fc = 1,2, . . . ,d\d2- We decompose each vector x t , 



xi! + x^, where x[j is parallel to 1 and x^~ is perpendicular to 1. Thus, 

^1^2 \ 



1 



.c 



V 



dick 



^ J 1 and 



x 



X^j x 



7' " 



(1) 



fc=i 



We denote by e v the u-th standard basis vector of K )Vl+,V2 . Then, for x £ 
^N 1 d l d 2 +N 2 d 1 d 2 we have 

x= V] e t ,®x l) = V] e " ® ( x tl + x t!~) = e f ® ^i! + e «® a; «- 

ti£7(G) vGV(G) veV(G) veV(G) 



We define := 



gyjgj c^, ® Xv and x 



Y.vev(G) e v® x v ■ Therefore 



x = x" + x 



Since Xv -L x^~ for all v € ^(G), it follows that a; 



c 1 " and thus lice 
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With the above definitions, and using the symmetry of BAB, we have 



\xMx T \ = \xBABx T \ 

and thus 

\xMx T \ - 



,11 



x ± )BAB(x 11 +:r ± ) 



x ll BAB(x"j J 



x ll BAB{x 



Yx^BABix^) 1 



(2) 



Now we will find upper bounds depending on a, (3\, /3 2 for each of the three 
terms above. 

We start with the term \x ± BAB(x ± ) T \. We have 

\x^BAB{x^) T \ = \x ± BA(x ± B) T \ < \\x^BA\\ ■ \\x^B\\ = \\x^B\\ ■ \\x^B\\. 

The first equality follows from the symmetry of B, the inequality is given by 
Cauchy-Schwarz and the last equality follows from the fact that A is a permu- 
tation matrix. 

With the previous notation (for each v G V(G) the vector belongs to 
R dld2 ), x ± B equals 



(xiAdiH,), ^Ad(ffi), . . . , as^AdC^i) , xj^ 1+1 Ad(H 2 ) , 



i x N!+N 2 



Ad(H 2 )). 



For any vector z G ^N 1 d 1 d2+N 2 d 1 d 2 ^ we c} eno te by zjj 1 the vector consisting of 
the first N\d\d,2 entries of z and by z H2 the vector consisting of the last N 2 d\d 2 
entries of z. 

Using the fact that for each v G {1,2,.. . , Aq}, is a linear combination of 
eigenvectors for Hi different from 1 and for each v G {Aq + 1, Aq + 2, . . . , Aq + 
N 2 }, Xy is a linear combination of eigenvectors for H 2 different from 1, we have 



\\x^B\\ <fadi \\xj Il \\+ fad 2 1 |4J|. 



(3) 



Thus, 



x^B\\ 2 < 0ld\\ \x^ 1 1 2 + 2(3 1 l3 2 d 1 d 2 \ \xjj x \ \ ■ \ \xjj 2 \ \ + «| \x% 



32j2ii _L 1 1 2 



Since 



211^11- IKII^II^II' + IKII^H^II 5 



and \\xjj z \\ 2 < llx^H 2 , i = 1,2, we have 

\x^BAB(x^f\ < \\x^B\f < (pl d ± + p 1 p 2 + ( 3l d l ) 
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Next we examine the term |o;- L .BAB(a:ll)- r |. 

Since a; 11 = (4 1 , arjj , . . .j^^ivi+i' . . .,4i+jv 2 )' and for each?; e {1,2, . . . ,7Vi} 
the vector xJJ is an eigenvector for Ad(Hi) with eigenvalue d\ and for each 
v € {Ni + 1, JVi + 2, . . . , Ni + N 2 } the vector Xv is an eigenvector for Ad(H 2 ) 
with eigenvalue d 2 , we have 



Lb = (rfi^j^^ijj 



(5) 



Thus 



x ± BAB(x l 



x ± BA(x"B) 1 



BA(d 1 x% i ,d 2 x% 2 f 



Since A is symmetric, we have 



x ± BAB(x l 



(x^B)Ud l x l j Ii ,d 2 x l j l2 )A 



Using the Cauchy- Schwartz inequality, ((6]) is bounded above by 

ii^bii.ik^^^jaii. 



(6) 



(7) 



Using ([3]) and the fact that the matrix A is a permutation matrix with the 
diagonal blocks consisting of zero entries, expression ([7]) is bounded above by 



Since 



'rffii^iP+^lkkll 2 ^ ^114,11+^114,11 <(di+<fe)ii»"i 

is bounded above by 

(/3 1 d 1 +/3 2 d 2 )(d 1 +d 2 )||x J -||-||xll||. 



Since Hx^H • \\x^\\ < -\\x\\ 2 , we have 



x ± BAB(x") rj 



(8) 



Finally examine the term |a;"i?j4i?(xll)' r | 
Using we have 



\BAB( X Wf 



BA(x^B) T = (d 1 x l j Ii ,d 2 x^ 2 )A(d 1 x l l Ii ,d 2 x% 2 ) T (9) 
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j did 2 



did 



fe=l 



jdij/jVjljtfeyiVi+il, • ■ ■ , d2yN 1 +N 2 l) 1 



We recall the definition ((T|) of x[! and define y v 

1, . . . , JVi, JVi + 1, . . • , JVi + JV 2 . 

Thus © equals 

. . . , diy Nl l, d 2 y Nl+ il, ■ ■ ■ , d 2 yN 1 +N 2 l)A(diyil, 

where 1 is the vector in R dld2 with all entries 1. 

By the definition of the matrix A, the first d\d 2 entries of 

(dij/il, . . . , diyjvil, tfcj/^+il, ■ ■ ■ j rf2j/jvi+jv 2 l)^4 

are d 2 y Nl+n > d 2 yN 1 + ]1 , ■ ■ ■ , d 2 y Nl+ndld2 , where N x +j 1 ,N 1 +j 2 ,..., Nt +jd 1 d 2 
are the neighbors of the first vertex in G. Similarly, the next d\d 2 entries are d 2 
multiples of y's corresponding to neighbors of the second vector in G, etc. Of 
course, once we get to entries corresponding to neighbors of right vertices in G, 
these are multiples of d\ . 



Therefore, the expression © equals 



did 2 ( yi ^2 yj +y 2 ^2v] 



■ yNi_+N 2 



vs) 



j~Ni+N 2 



= did 2 \(yi, . . .,y Nl+N2 ) Ad(G)(j/i, . . .,y Nl+N2 ) T \ . 
With y := (yi, . . . , 2/jVi+JV a ) the expression above equals d\d 2 \y Ad(G)y T \ 
Thus, by the Cauchy-Schwartz inequality 

x^BAB(x^f\ <d 1 d 2 \\y kd{G)\\-\\y\\. 
Since y _L ljv^jv^i we have 

x^BAB{x^) T < <%<%a\\y\\ 2 . 
Since ||x"|| 2 = did 2 ||j/|| 2 , we have 



x^BAB(x l 



< did^Wx^w 2 . 



(10) 



Using the bounds (jHJ) and (JTUJ) , in expression ©, we obtain 



xMx 1 ] < LSf-i + /3i/3 2 + (3 2 

\ "2 

Since Wx 1 - 
\xMx T \ ' 



2 a 2 



did 2 \\x 



d 2 ™ "*dx 
x^\\ < \\x\\ and llxll = 1, we have 



,dx 
d~ 2 



2 d 2 



di I I \ d 2 d\ 



a did 2 , 



which concludes the proof of the theorem. 
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4 Conclusion 



Note that when d\ = di the modified ta%-t,&% product gives a slightly worse 
bound for X(G® (iJi,/^)) than the bound obtained from the zig-zag product 
introduced in [5], Thus, the modified zig-zag product should only be used when 
constructing a family of infinite expanders of non-square degree. 
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